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ABSTRACT 



A motion vector detection device is provided that can 
suitably detect motion vectors by setting an optimum search 
range of vector values of a motion vector. The motion vector 
detection section 103 sequentially matches the input data 
101 with the reference image data 102 every divided region 
and detects the motion vector 104 within a search range of 
specified vector values. The histogram creation section 105 
increments a motion vector detection frequency stored in the 
histogram recording section 109 corresponding to a range to 
which the vector value of the detected motion vector 104 
belongs. When the increment process for one frame has been 
completed, a histogram for a motion vector detection fre- 
quency for one frame is formed in the histogram recording 
section 109 and is corrected if necessary. The shift amount 
setting section 107 decides the shift amount of a search 
range specified in the next frame by the search range setting 
section 108, according to the created (corrected) histogram. 

15 Claims, 17 Drawing Sheets 
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DEVICE AND METHOD OF DETECTING 
MOTION VECTORS 

BACKGROUND OF THE INVENTION 

The present invention relates to a device and method of 
detecting motion vectors. More particularly, the present 
invention relates to a technique of decreasing computational 
complexity for motion vector detection and realizing proper 
motion vector detection. 

The motion compensated inter-frame prediction system 
using block matching operations has been standardized and 
widely used as a technique of efficiently encoding motion 
image data. The mterframe prediction requires to detect 
motion vectors. In order to capture large motion vectors, the 
vector value of a motion vector must be widely searched. 
However, a wide search range of motion vectors leads to the 
enormous computation for the matching process, thus caus- 
ing the disadvantage in enlarging the system scale and in 
making the real-time processing difficult. 

In order to deal with such problems, JP-A No. 166684/ 
1989 (hereinafter referred to as a prior art 1) discloses a 
motion vector detection device while JP-A No. 328333/1993 
(hereinafter referred to as a prior art 2) discloses a motion 
vector detection device. 

FIG. 19 is a block diagram illustrating the configuration 
of the motion vector detecting device according to the prior 
art 1. In the motion vector detection device, the frame 
memory 201 stores reference image data. The reference 
point setting section 202 sets reference points referred to 
according to the search motion vector by using the reference 
image data stored in the frame memory 201 based on an 
offset set by the horizontal offset control section 206 and an 
offset set by the vertical offset control section 207. The 
subtracting section 203 obtains a difference between input 
data and a reference point. The frame difference addition 
section 204 sums differential data sets being output results 
from the differential section 203. The minimum value detec- 
tion section 205 detects a minimum value of the sum and 
then detects a motion vector to provide a horizontal motion 
vector component Vx and a vertical motion vector compo- 
nent Vy. The adding section 210 adds an offset value selected 
by the selector 208 to the motion vector horizontal compo- 
nent Vx from the minimum value detection section 205. The 
adding section 211 adds an offset value selected by the 
selector 209 to the motion vector horizontal component Vy 
from the minimum value detection section 205. Thus, the 
final motion vector (horizontal motion vector component 
and vertical motion vector component) is computed. The 
horizontal offset control section 206 sets an offset value for 
motion vector search in the next frame by the horizontal 
component Vx of a motion vector from the minimum value 
detection section 205. The vertical offset control section 207 
sets an offset value for motion vector search in the next 
frame by the vertical component Vy of a motion vector from 
the minimum value detection section 205. 

In the offset setting operation of the horizontal offset 
control section 206 and the vertical offset control section 
207, one motion vector component is expressed by the 
following formula: 

where 8V(n) is the offset value of the n-th frame; and AV is 
a search range. One component V of a motion vector is 
expressed by the range satisfying -V^V^AV. The value of 
a is expressed the formula of a=l (V=AV), a«-l (V«AV), 
or a=0 (V*A, -AV)). 
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FIG. 20 is a block diagram illustrating the configuration 
of the motion vector detecting device according to the prior 
art 2. In the motion vector detection device, the motion 
vector detection circuit 301 detects a motion vector provid- 

5 ing a minimum prediction error based on image data for an 
input current frame and reference image data over a search 
range of specified by the selector 304. The motion vector 
memory 302 stores the detected motion vector for the 
duration of one frame and then outputs it as a motion vector 
at the same position on the previous frame to the search 
range decision section 303. 

The search range decision section 303 judges the search 
range of motion vectors in a target block within the current 
frame according to the magnitude and direction of the 
motion vector of the previous frame. The selector 304 

15 selectively outputs one of N search ranges ranging from the 
first search range to the n-th search range according to 
decision results of the search range decision section 303. 
The motion vector detection circuit 301 searches motion 
vectors over a selected search range. 

20 In addition to the normal search range shown in FIG. 
21(a), the selector 304 outputs the search range attaching 
importance to the horizontal direction as shown in FIG. 
21(6), the search range attaching importance to the vertical 
direction as shown in FIG. 21(c), or the search range 

25 attaching importance to the slanting direction as shown in 
FIG. 21(d). The search range attaching importance to the 
horizontal direction as shown in FIG. 22(b) and the search 
range attaching importance to the vertical direction as shown 
in FIG. 22(c) can be used as a modified search range, in 

30 addition to the normal search range shown in FIG. 22(a) 
However, the prior arts 1 and 2 have the following 
drawbacks: 

In the prior art 1, the search range cannot be followed 

under an occurrence condition of some motion vectors so 
35 that the optimum search range of motion vectors cannot be 

covered. As a consequence, the prior art 1 cannot suitably 

detect motion vectors. 
The prior art 2 has a disadvantage in that the motion 

vector cannot be suitably detected because only limited 
40 types of search range can be selected. Moreover, since the 

search range over a motion boundary portion is often 

predicted erroneously, the motion vector cannot be suitably 

detected. 

As a related art, JP-A-No. 30407/1993 (hereinafter 
45 referred to as prior art 3) discloses a motion vector detection 
technique for realizing the automatic mechanism such as 
autofocus, autoiris or the like for cameras. 

In the prior art 3, a partial physical region in the image 
pickup region 401 acts as the motion vector detection region 
50 403 for motion vector detection, as shown in FIG. 23. 

The motion vector detection region 403 is divided into 
plural sub-divided regions 404 to create a histogram show- 
ing vector values of motion vectors detected for the sub- 
divided regions 404. The motion vector detection region 403 
55 on the next frame is decided by setting the motion vector 
with the highest occurrence frequency on the histogram as 
the motion vector of the subject 402. 

However, the process ranging from creation of a histo- 
gram to the computation of the motion vector detection 
60 region 403 on the next frame is realized by software. Hence, 
where the method is applied to encode motion images 
needed to detect motion vectors of the whole image region 
within one frame, a sophisticated processing circuit such as 
processor or microprocessor with considerable high process- 
es ing capability is required. 

When an image contains a still portion, the occurrence 
frequency of (0, 0)in a detected motion vector becomes high. 
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However, in the prior art 3, since a correction process is not ing to the number of vector values of a motion vector 

performed to motion vectors with high occurrence frequency contained within the search range, so that the storage capac- 

at (0, 0), the motion vector detection region 403 may not be ity can be saved. 

suitably set according to the motion of the subject 402. The motion vector detection device m ay further com- 

Moreover, since the same matching process must be 5 prises storage control means for incrementing the number 

performed for motion vector detection, regardless the degree corresponding to a range containing the detected vector 

of the motion of the subject 402, the computational com- value among motion vector numbers stored in the motion 

plexity for the matching process becomes enormous to v6Ctor frequency storage means every time the motion 

capture a specially large motion vector vector detection means detects the vector value of a motion 

1Q vector in each of each divided region. 

SUMMARY OF THE INVENTION In the motion vector detection device, the indication 

means indicates the motion vector search range so as to 

The present invention is made to solve the above- center a vector value corresponding to the maximum number 

mentioned problems. The objective of the present invention among the motion vector numbers classified and stored by 

is to provide a motion vector detection device that can the motion vector frequency storage means, 

reduce the computational complexity by limiting the range 15 i n this case, where there are plural classifications each 

searching for the vector values of a motion vector for, which contains the greatest number of motion vectors, the 

particularly, motion image encoding applications and can search range of vector values of the motion vector may be 

suitably detect motion vectors by setting an optimum search indicated so as to center the vector value corresponding to 

range. the barycentric position of them. 

Another objective of the present invention is to provide a 20 In tne motion vector detection device, the indication 

motion vector detection method that can reduce the compu- means indicates a motion vector search range based on a 

tational complexity by limiting the range searching for the number with numbers larger than a predetermined threshold 

vector values of a motion vector for, particularly, motion value among the motion vector numbers classified and 

image encoding applications and can suitably detect motion stored in the motion vector frequency storage means, 

vectors by setting an optimum search range. In this case, in the classification where vector values of a 

The objective of the present invention is achieved by a motion vector detected by the motion vector detection 

motion vector detection device comprising motion vector means exceed a predetermined threshold, it is not needed to 

detection means for dividing image data on a current frame store numbers exceeding the number of the corresponding 

into predetermined regions, matching the image data on the 30 vector values. Thus, the bit number to store the number of 

current frame with reference image data every divided motion vectors detected every classification can be reduced 

region, and detecting motion vectors with vector values so that the storage capacity of the motion vector frequency 

within a search range externally indicated; motion vector storage means can be reduced. 

frequency storage means for classifying the motion vectors The motion vector detection device further comprises 

within each divided region detected by the motion vector 35 correction means for correcting a motion vector number 

detection means under the vector value range and then stored in the motion vector frequency storage means. The 

storing the number of the motion vectors; and indication indication means indicates a motion vector search range to 

means for indicating a search range of vector values of a be detected by the motion vector detection means, based on 

motion vector to be detected by the motion vector detection the motion vector number corrected by the correction means, 

mean, based on the number of the motion vectors classified 40 The correction means includes means for correcting the 

and stored by the motion vector frequency storage means. number corresponding to a classification containing a 

In the motion vector detection device, the motion vector motion vector with the vector value of (0, 0), among motion 

frequency storage means classifies the number of vector vector numbers stored in the motion vector frequency stor- 

values of a motion vector detected by the motion vector a g e means. Since moving images generally contain many 

detection means and stores the classified data in the form of, 45 still regions, the vector value of a motion vector detected 

for example, a histogram. The motion vector detection from each divided region by the motion vector detection 

device can be indicated a search range of vector values of a means is often expressed by (0, 0). If the number of motion 

motion vector according to the histogram. That is, when the vectors at (0, 0)is not corrected, the situation may occur 

motion of a subject is uniform, the image data of a motion where the center of the search range of vector values of the 

image has a localization in the vector value of a motion 50 motion vector is always set to (0, 0). The above-mentioned 

vector. Hence, the motion vector detection can be suitably correction means can prevent such a situation and can 

performed by indicating a search range of vector values of establish a suitable search range. Moreover, the correction 

a motion vector to be detected in the next frame according means includes means for smoothing the motion vector 

to the vector value of a motion vector detected in the image numbers classified and stored in said motion vector fre- 

data for the previous frame. Moreover, since the vector value 55 quency storage means within close vector value ranges by 

of a motion vector to be detected is limited, the computa- classification. 

tional complexity which is required in a matching process Thus, the correction means can remove a local effect on 

where the motion vector detection means detects the motion the detection results of a motion vector and can establish a 

vector can be reduced. In the motion vector detection, the suitable search range from the whole situation, 

motion vector frequency storage means classifies motion go As described above, in the motion vector detection device 

vectors within each divided region detected by the motion having the correction means, the indication means indicates 

vector detection means so as to contain the vector values of the motion vector search range so as to center the vector 

plural motion vectors within one range and then stores the value corresponding to a classification having the largest 

number of the motion vectors. motion vector among classifications containing the motion 

In this case, one range in the histogram contains plural 65 vector number corrected by the correction means, 

vector values. Hence, the motion vector frequency storage The indication means indicates a motion vector value 

means is not required to have a storage capacity correspond- search range based on numbers with a larger value than a 
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predetermined threshold value among the motion vector 
numbers corrected by the correction means. 

In the motion vector detection device, the time interval 
between the reference frame and the current frame may 
differ for each frame. In this case, the indication means 5 
indicates a motion vector value search range according to a 
time interval between the reference image data and image 
data for the current frame. 

Thus, even if the time interval between the reference 
image data and the image data for a current frame is different 10 
from each frame, the search range of vector values of a 
motion vector can be always set to a suitable range. 

When the time interval between a reference frame and 
image data in a current frame is different every frame, the 
reference image data may come before and after image data 5 
for the current frame in input order. In this case, the motion 
vector frequency storage means includes means for adjust- 
ing vector values of motion vectors detected by the motion 
vector detection means to provide a different sign when the 
reference image data comes before or after image data for 
the current frame. 20 

In the motion vector detection device, the motion vector 
detection means can detect plural motion vectors from each 
of divided regions. In this case, the motion vector frequency 
storage means assigns weights to motion vector numbers 
detected from each divided region by the motion vector 25 
detection means and then stores the weighted motion vector 
numbers. 

In order to accomplish the above-mentioned object, the 
motion vector detecting method comprises a vector motion 
detection step of dividing image data for a current frame into 30 
predetermined regions, matching the image data of the 
current frame with reference image data every divided 
region; and detecting a motion vector with a vector value 
within a search range externally indicated; a motion vector 
distribution creation step of creating a distribution where 35 
motion vectors detected from each divided region in the 
motion vector detection step are classified every range of 
predetermined vector values; and an indication step of 
indicating a motion vector value search range to be detected 
in the motion vector detection, based on the distribution 
created in the distribution creation step. 4 

BRIEF DESCRIPTION OF THE DRAWINGS 

This and other objects, features and advantages of the 
present invention will become more apparent upon a reading 
of the following detailed description and drawings, in 45 
which: 

FIG. 1 is a schematic block diagram illustrating the 
configuration of a motion vector detection device according 
to an embodiment of the present invention; 

FIG. 2 is a block diagram illustrating a detail coofigura- 50 
tion of a motion vector detection device according to an 
embodiment of the present invention; 

FIG. 3 is a diagram explaining a shift of a motion vector 
search range; 

FIG, 4 is a diagram explaining an example of a histogram 
for the detection frequency of a corrected motion vector; 

FIG. 5 is a diagram explaining positions of a shift amount 
to be set; 

FIG. 6 is a diagram explaining a method of configuring a 60 
histogram for a motion vector detection frequency; 

FIG. 7 is a diagram explaining another example of a 
histogram for a motion vector detection frequency; 

FIG. 8 is a diagram explaining a method of adjusting shift 
amounts according to time intervals when the time interval 65 
between input data and reference image data varies every 
frame; 
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FIG. 9 is a diagram explaining time intervals between 
image data sets in the case of field prediction; 

FIG. 10 is a diagram explaining time intervals between 
image data sets for field prediction; 

FIG. 11 is a diagram explaining time intervals between 
image data sets for field prediction; 

FIG. 12 is a diagram explaining time intervals between 
image data sets for field prediction; 

FIG. 13 is a diagram explaining time intervals between 
image data sets for dual prime prediction; 

FIG. 14 is a diagram explaining time intervals between 
image data sets for dual prime prediction; 

FIG. 15 is a block diagram illustrating the configuration 
of a motion vector detection device according to a modified 
embodiment of the present invention; 

FIG. 16 is a diagram illustrating simulation results of a 
motion vector detection device according to the present 
invention; 

FIG. 17 is a diagram illustrating simulation results of a 
motion vector detection device according to the present 
invention; 

FIG. 18 is a diagram illustrating simulation results of a 
motion vector detection device according to the present 
invention; 

FIG. 19 is a block diagram illustrating the configuration 
of a motion vector detection device according to the related 
art 1; 

FIG. 20 is a block diagram illustrating the configuration 
of a motion vector detection device according to the related 
art 2; 

FIG. 21 is a diagram explaining a motion vector search 
range of a motion vector detection device according to the 
related art 2; 

FIGS. 22a, 22b 7 and 22c are diagrams explaining a motion 
vector search range of a motion vector detection device 
according to the related art 2; and 

FIG. 23 is a diagram explaining the motion vector detec- 
tion of the related art 3. 

DESCRIPTION OF THE EMBODIMENTS 

Next, embodiments of the present invention will be 
described below in detail with reference to the attached 
drawings. 

First, a motion vector detection device according to an 
embodiment of the present invention will be roughly 
described by referring to the block diagram of FIG. 1. 

The motion vector detection device divides input data 
(image data) 101 into regions each covering predetermined 
areas and searches for a motion vector every divided region. 
The motion vector detection device consists of a motion 
vector detection section 103, a histogram creation section 
105, a histogram correction section 106, a shift- amount 
setting section 107, a search range setting section 108, and 
a histogram storage section 109. 

The motion vector detection section 103 divides the input 
data 101 and the reference image data 102 for one frame into 
regions of a predetermined size and detects the motion 
vector 104 by the matching process between the input data 
101 and the reference image data 102 for the every divided 
region. The search range setting section 108 specifies the 
search range of vector values of a motion vector detected by 
the motion vector detection section 103 according to the 
results processed in the previous frame. 

The histogram recording section 109 divides the search 
range of vector values of a vector value into regions each 
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covering predetermined values and stores a histogram rep- 
resenting a motion vector detection frequency over each 
vector value range. 

The histogram creation section 105 increments a motion 
vector detection frequency to be recorded in the histogram 
recording section 109 over the range corresponding to the 
vector value of a motion vector 104 detected by the motion 
vector detection section 103 in order to create a histogram 
representing motion vector detection frequencies. The 
motion vector detection frequency incremented by the his- 
togram creation section 105 is controlled according to the 
search range set by the search range setting section 108. The 
histogram correction section 106, if necessary, compensates 
the motion vector detection frequency stored in the histo- 
gram storage section 109. 

After the correction of a histogram by the histogram 
correction section 106 or after a judgment on no need of 
correction, the shift-amount setting section 107 decides the 
shift amount of a motion vector search range according to 
the motion vector detection frequency histogram stored in 
the histogram storage section 109. The search range setting 
section 108 specifies a motion vector search range of the 
motion vector detection section 103 according to the shift 
amount decided by the shift amount setting section 107. 

The motion vector detection section 103, the histogram 
creation section 106, the shift amount setting section 107 
and the search range setting section 108 are respectively 
configured of a dedicated hardware. The function of each 
element may be configured of a software and a processor 
executing the same. The histogram storage section 109 can 
be formed by securing regions in a memory. 

The operation of the motion vector detection device 
according to the embodiment will be roughly described 
below with reference to FIG. 1. 

In an initial operation, all motion vector detection fre- 
quencies in the previous frame process stored in the histo- 
gram storage section 109 are cleared to "0" before starting 
a process for one frame. When a frame is the first frame 
subjected to interframe prediction, the shift amount setting 
section 107 sets the shift amount to (0, 0). 

When the processing for one frame is started, the motion 
vector detection section 103 detects the motion vector 104 
by subjecting the input data 101 and the reference image 
data to a matching process every divided region. The 
detected motion vector 104 is output to the histogram 
creation section 105 and is externally sent out for an 
encoding process. 

In response to the motion vector 104, the histogram 
creation section 105 increments the motion vector detection 
frequency stored in the histogram recording section 109 
within a range corresponding to the vector value of the 
motion vector 104. The increment process is performed to 
all divided regions within one frame by means of the motion 
vector detection section 103 and the histogram creation 
section 105. 

When the process for one frame is finished, the detection 
frequency is determined for the vector value range of the 
motion vector 104 detected in each divided region, so that a 
histogram is created. The created histogram is corrected, if 
necessary, by the histogram correction section 106. 

After either the histogram correction by the histogram 
correction section 106 or a judgment on no need for 
correction, the shift amount setting section 107 decides a 
search range shift amount which specifies a range for 
searching for vector values of a motion vector to be detected 
in the next frame, according to the motion vector detection 
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frequency histogram stored in the histogram storage section 
109. The search range setting section 108 sets a search range 
to be processed in the next frame, based on the decided shift 
amount. 

5 In the next frame processing step, the motion vector 
detection section 103 specifics the search range set by the 
search range setting section 108 as a motion vector search 
range of a motion vector to be detected. 
Next, the motion vector detection device according to the 

10 present embodiment will be described in more detail by 
referring to the block diagram of FIG. 2. 

FIG. 2 shows the detail configuration of the motion vector 
detection device shown in FIG. 1. The histogram creation 
105 and the histogram correction section 106 arc shown in 

15 more concrete. A frequency memory 119 corresponds to the 
histogram storage section 109 of FIG. 1. 

The histogram creation section 105 consists of an address 
conversion section 111 and an incrementer 112. The address 
conversion section 111 outputs an address in the frequency 

2Q memory 119 which stores a motion vector detection fre- 
quency which corresponds to a range of the vector values of 
the detected motion vector 114. The incrementer 112 incre- 
ments by "1" a motion vector detection frequency read out 
of the frequency memory 116 according to the output from 

25 the address conversion section 111. The motion vector 
detection frequency incremented by the incrementer 112 is 
re -written to its corresponding address in the frequency 
memory 119. 

The histogram correction section 106 is formed of an 

30 address creation section 113 and amultiplier 114. The 
address creation section 113 outputs an address in the 
frequency memory 119 according to the output from the 
shift amount setting section 107 while the frequency 
memory 119 stores a vector detection frequency correspond- 

35 ing to a range to be corrected. For the purpose of correction, 
the multiplier 114 multiplies the motion vector detection 
frequency read out of the frequency memory 119 according 
to the output from the address creation section 113 by a 
predetermined constant output via the selector 115. A motion 

4 q vector detection frequency multiplied and corrected by 
means of the multiplier 114 is re-written to the correspond- 
ing address in the frequency memory 119. 

The frequency memory 119 consists of memory regions 
whose word number is corresponding to the number of 

45 respective ranges in a histogram which records motion 
vector detection frequencies. In this embodiment, the histo- 
gram has ranges provided in one pixel unit. The number of 
ranges in a histogram is 64 (-8x8), as described later. Hence, 
the word number of the frequency memory 119 is 64. 

50 The shift amount setting section 107 is formed of, for 
example, combinational logical circuits. When a histogram 
is created within the frequency memory 119, the shift 
amount setting section 107 reads it out of the frequency 
memory 119 to judge whether or not some correction is 

55 needed. When correction is required, the shift amount set- 
ting section 107 outputs a control signal for creating an 
address to be corrected and a control signal for selecting a 
predetermined constant by the selector 115 to the address 
creation section 113. The shift amount setting section 107 

60 decides a search range shift amount for designating a vector 
value search range of a motion vector to be detected in the 
next frame, according to a corrected histogram or according 
to the original histogram when the judgment indicates no 
need for correction. 

65 The search range setting section 108 sets a vector value 
search range of a motion vector according to the shift 
amount determined by the shift amount setting section 107. 
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The setting of a vector value search range of a motion the shift amount output in the previous process from the shift 

vector by the search range setting section 108 will be amount decision section 107. Thus, the frequency memory 

described with reference to FIG. 3. Referring to FIG. 3, 119 outputs the detection frequency of a motion vector with 

round symbols represent the search points of motion vectors. a vector value (0, 0). The multiplier 114 multiplies the 

As shown in FIG. 3, the normal search range satisfies the 5 detection frequency by a predetermined constant output 

inequalities -4iMVx^+3 and -4^M Vyi+3. When the from the selector 115. The multiplication result of the 

shift amount setting section 108 indicates (2, 4) as the shift multiplier 114 is re-written to the same address of the 

amount from, the search range satisfies the inequalities frequency memory 119. 

-2iMVxi+5 and 0§MVy§ +7. For example, referring to the histogram shown in FIG. 4, 

Next, the operation of the motion vector detection device 10 it is now assumed that the detection frequency of a motion 

shown in FIG. 2 will be described below. vector with the vector value (0, 0) is 20. The multiplier 114 

Here, the case where motion images are processed in the multiplies the detection frequency "20" by "0.5". Thus, the 

forward direction and the time interval between the input detection frequency of a motion vector with the vector value 

data 101 and the reference image data 102 does not vary (°> °) ^ corrected to "10" smaller than "20". 

every frame will be described as an example. 15 In the above-mentioned step, when the motion vector 

When a frame is the first frame subjected to interframe detection frequency histogram stored in the frequency 

prediction, the shift amount setting section 107 sets the shift memory 119 is corrected, the shift amount decision section 

amount of a search frequency of a vector value of a motion l 08 decides the search range shift amount in such a way that 

vector to (0, 0). Hence, the search range specified by the * vector value to be increased in the corrected histogram 

motion vector detection section 104 is expressed by the 20 comes to the center of a search range in the next frame 

inequalities -4iMVx§+3 and -4iMVyi+3. In other process. Based on the decided shift amount, the search range 

cases, the shift amount of the search frequency of a vector setting section 108 specifies the search range in the next 

value of a motion vector is set based on the histogram &ame process to the motion vector detection section 104. 

created in the frame processing step in which the interframe For example, as shown in FIG. 4, the highest detection 

prediction has been performed just before the current opera- frequency of a motion vector with a vector value (-1, 0) is 

tion. In an initial process before starting a process for one "15". Hence, the shift amount setting section 108 sets the 

frame, all storage contents within the frequency memory 119 shift amount of a search range in the next frame process to 

are cleared to "0". (-1, 0). Thus, the search range of the vector quantity of a 

When the process for one frame is started, the motion motion vector in the next frame process is set to the range 

vector detection section 103 detects the motion vector 104 expressed by the -5^MVx^+2 and -4^MVy^+3. 

by matching the input data 101 and reference image data 102 In the next frame process, the motion vector detection 

and the reference image data 103 to the reference image data section 104 searches for the motion vector which has vector 

for each divided region. The matching process for detecting values within a search range set by the search range setting 

the motion vector 104 is performed according to a motion 35 section 108. 

vector value search range decided based on the shift amount As described above, in the motion vector detection device 

set by the shift amount setting section 107. That is, only the in the above-mentioned embodiment, the frequency memory 

matching process of detecting motion vectors with vector 119 stores the detection frequency of the motion vector 104 

values within a search range is performed but the matching from the motion vector detection section 103 in the form of 

process of detecting motion vectors with vector values out of 4Q a histogram classified every vector value. Then, the shift 

a search range is not performed. amount setting section 107 sets the vector value with the 

The motion vector detection section 103 sequentially highest detection frequency as a shift amount. In the next 

outputs the motion vectors 104 detected in the matching frame, the shift amount comes to the center of the search 

process every divided region. Regarding the regions where range set by the search range setting section 108. 

motion vectors with the vector values within a search range 45 That is, the search range of a motion vector to be detected 

are not detected, the motion vector detection section 103 in the next frame can be suitably set by using the localization 

does not output any motion vector but processes the next of the vector value of a certain motion vector contained in 

divided region. The motion vector detection section 103 the image data of a moving image. For that reason, the 

outputs the motion vector 104 to circuits outside the device motion vector detection device according to the present 

of FIG. 2 to perform an encoding process and outputs it to 50 embodiment can suitably detect motion vectors. Moreover, 

the address conversion section 111 in the histogram creation since the motion vector to be detected by the motion vector 

section 105. detection section 104 is limited within a search range in 

In response to the motion vector 104, the address con- which the vector value thereof is specified by the search 

version section 111 outputs an address of the frequency range setting section 108, the motion vector setting section 

memory 119 for storing the motion vector frequency corre- 55 104 can limit the repetitive cycle of the matching process 

sponding to the vector value of the motion vector 104. Thus, which detects motion vectors. Thus, the computational com- 

the frequency memory 119 outputs the motion vector fre- plexity required for motion vector detection can be reduced, 

quency corresponding to the vector value of the motion Moreover, the histogram correction section 106 sets the 

vector 104 while the incrementer 112 increments the output vector value so as to decrease the detection frequency of a 

by "1". Then the result is re-written to the same address. 60 motion vector with the vector value of (0, 0). This operation 

When the above process is completely applied to data of can prevent a motion vector value search range from being 

each divided region for one frame, the motion vector detec- always set to the center (0, 0) although the vector value at 

tion frequency histogram is determined. (0, 0) tends to be most detected as the center at still image 

The address creation section 113 in the histogram correc- regions in a motion image, 

tion section 106 outputs an address from which the detection 65 It should be noted that the present invention is not limited 

frequency of a motion vector with the vector value (0, 0) only to the above-mentioned embodiment. Various modifi- 

stored in the frequency memory 119 is output, according to cations can be applicable to the circuit configuration and 
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creation and correction of a histogram. Modifications of the Furthermore, when plural motion vectors are detected in 
present invention will be described below. one divided region, the system that uses only the first vector 
It should be noted that the vector value search range of a or only vectors in the same parity can be employed. This 
motion vector is not limited to the square form shown in the system can simplify the process and can sufficiently grasp 
above-mentioned embodiment but may be represented as a 5 the tendency of the motion of an image, 
rectangular form plural rectangular forms, or a given form Moreover, regions where motion vectors cannot be 
designated by a bit map. Even if the search region lof vector dctcctcd oocur< For cxamplc> this whcD M 
values of a motion vector has a given form, the histogram in|rafiainc encodin mode ^ xhtled ia MPEG _ 2( whicb 
storage section 109 (or the frequency memory 119) can intra-encoding but is not performed an inter- 
usefully work that has a sufficient capacity of storing the in £ 4 . , ... 6 t . « j . *■ 
detection frequencies of a motion vector. 10 ^ Paction In this case, the motion vector detection 
™« j. 1 ■ ■ ,l ft \ frequencies stored m the histogram storage section 109 (or 
FIG. 5 is a diagram explaining the positions (or locations) t . V 11in v * 4 j4 t V 

of adjustable shift amounts. Tins example shows that a shift lhe fre 1 uenc y memor >; U9 > m not Otherwise, the 

amount can be set at the black point. That is, it is shown that m f on vector d u etected as a ^on-intra mode before the mode 

the shift amount can be vertically and horizontally set over Pigment may be measured as the detection frequency, 

the range of -16 to +16 in 8 pixel units. 15 NG. 7 is a diagram explaining another method for setting 

FIG. 6 is a diagram explaining the method of configuring the shift amount of a search range by the shift amount setting 

a motion vector detection frequency histogram. section 107. 

In this example, the normal search range of vector quan- In ^ embodiment, the shift amount correction section 

tities of a motion vector is set to -16^MVx^+15 and 20 106 subjects a histogram to a threshold process. In FIG. 7, 

-16iMVy i+15. The vertical and horizontal components of th , e motion vector detection frequencies of 2 and more in the 

a motion vector are divided into five steps including -16 to histogram shown in FIG. 6 are expressed as "1" in binary 

-13, -12 to -5, -4 to +3, +4 to +11, +12 to +15 in such a notation. The motion vector detection frequencies of less 

way that the adjustable positions of the shift amount shown | han . 2 m thc histogram shown in FIG. 6 are expressed as "0" 

in FIG. 5 are centered. Tnis can be accomplished by securing 25 * D binary notation. 

a region for 25 words (=5x5) within the histogram storage In this case, the shift amount setting section 107 sets the 

section 109 (or the frequency memory 119). Thus, the average value (-0.928, -0.275) of motion vectors represent- 

memory capacity can be reduced, compared with the ere- ing " 1" in the binary-coded histogram as a search range shift 

ation of respective histograms for motion vectors in one amount. The shift amount setting section 107 sets the 

pixel unit. 30 average value (-1, -0.5) as a shift amount, -1 being the 

With the thus-divided search range, the number of motion average value between the maximum value and the mini- 
vectors to be searched becomes small in the corner segments mum value of horizontal components of a motion vector 
and on side segments shown in FIG. 6. In this case, the representing "1" in the binary-coded histogram and -0.5 
address creation section 113 in the histogram correction being the average value between the maximum value and the 
section 106 first outputs the address of each corner segment 35 minimum value of vertical components of a motion vector 
and then outputs the detection frequency of a motion vector. representing "1" in the binary-coded histogram. 
The selector 115 outputs the constant "4". The multiplier 114 The histogram creation section 104 may be designed in 
multiplies the detection frequency of a motion vector by the such a way that when the memory content of the histogram 
constant "4" and then rewrites the result to the correspond- storage section 109 (or the frequency memory 119) exceeds 
ing address of the frequency memory 119. Moreover, the 40 a threshold, the detection frequency is not incremented even 
address creation section 113 outputs the address of each side if the motion vector of the corresponding vector value is 
segment as well as the detection frequency of a motion detected. Thus, the bit number for storing the motion vector 
vector. On the other hand, the selector 115 outputs the detection frequency in each range can be reduced. As a 
constant "2". The multiplier 114 multiplies the detection result, the memory capacity of the histogram storage section 
frequency of a motion vector by "2" and then rewrites the 45 (or the frequency memory 119) can be reduced, 
result to the corresponding address of the frequency memory FIG. 8 is a diagram explaining the method of adjusting 
119. In this procedure, a difference between detection fre- shift amounts according to time intervals when the time 
quencies of a motion vector due to different magnitudes in interval between input data and reference image data varies 
respective sections can be corrected. every frame. 

In creation of the histogram, plural motion vectors with 50 In this example, the image is encoded as a P picture every 

the same prediction direction may be sometimes detected in three frames while the shift amount is encoded as a B picture 

respective divided regions. For example, such a situation every two frames. It is now assumed that after the image 

corresponds to the field prediction or dual prime prediction corresponding to the frame No. 1 is completely encoded, 

in a frame structure (to be described later) in MPEG-2 images are encoded in the order of the frame No. 4, frame 

(Moving Picture Experts Group). In that case, a histogram 55 No. 2, frame No. 3, frame No. 7, ... , sequentially. That is, 

may be created by counting all detected motion vectors. when images of the frame No. 4, frame No. 2, frame No. 3, 

In that case, all detected motion vectors may be equally frame No. 7, are the input data 101, the images correspond- 

handled or may be weighted according to the number of ing to the frame No. 1, the frames No. 1 and No. 4, and the 

motion vectors detected every divided region. When two frames No. 1 and No. 4, and the frame No. 4, . . . become 

motion vectors, for example, are detected in one divided 60 the reference image data 102. 

region, the detection frequency corresponding to each In this case, with the frame No. 1 set as a reference image, 

motion vector in the frequency storage section 109 (or the the search range of vector values of a motion vector related 

frequency memory 119) is incremented "1" by "1". When to the image in the frame No. 4 is determined. In the process 

one motion vector is detected in one divided region, the of the image in the frame No. 4, the motion vector of which 

detection frequency corresponding to each motion vector in 65 the time interval corresponds to three frames in the forward 

the frequency storage section 109 (or the frequency memory direction is searched. The shift amount setting section 107 

119) is incremented by "2". triplicates the shift amount, compared with the case where 
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the time interval corresponds to one frame in the forward 
direction as shown the above embodiment. 

Next, with the images in the frames No. 1 and No. 4 set 
as a reference image, the search range of vector values of a 
motion vector on the image in the frame No. 2 is determined. 
In the processing of the image in the frame No. 2, the motion 
vector in which the time interval corresponds to one frame 
in the forward direction is searched for the reference of the 
image from the frame No. 1. For the reference of the image 
from the frame No. 4, the motion vector in which the time 
interval corresponds to two frames in the backward direction 
is searched. In this case, the shift amount setting section 107 
negatively doubles the shift amount, compared with the case 
where the time interval corresponds to one frame in the 
forward direction. 

Next, with the images in the frames No. 1 and No. 4 set 
as reference images, the search range of vector values of a 
motion vector related to the image in the frame No. 3 is 
determined. In the processing of the image in the frame No. 
3, the motion vector in which the time interval corresponds 
to two frames in the forward direction is searched for the 
reference of the image from the frame No. 1. In this case, the 
shift amount setting section 107 doubles the shift amount. 
The motion vector in which the time interval corresponds to 
two frames in the backward direction is searched for the 
reference of the image from the frame No. 4. In this case, the 
shift amount setting section 107 sets the shift amount 
negatively, compared with the case where the time interval 
corresponds to one frame in the forward direction. 

Similarly, in the processing of the image in the frame No. 
7, the shift amount setting section 107 triplicates the shift 
amount, compared with the case where the time interval 
corresponds to one frame in the forward direction. In the 
processing of the image in the frame No. 5, the shift amount 
setting section 107 sets the shift amount twice for the 
reference from the frame No. 4, compared with the case 
where the time interval corresponds to one frame in the 
forward direction. In the processing of the image for the 
reference from the frame No. 7, the shift amount is nega- 
tively doubled. In the processing of the image in the frame 
No. 6, the shift amount setting section 107 doubles the shift 
amount for the reference from the frame No. 4, compared 
with the case where the time interval corresponds to one 
frame in the forward direction. The shift amount is nega- 
tively set for the reference from the frame No. 7. 

As described above, when the time interval between the 
input data 101 and the reference image data 102 varies every 
frame, the shift amount setting section 107 adjusts the shift 
amount to be set according to the time interval, so that the 
search range setting section 108 can set the search range of 
vector values of a motion vector to a suitable value. 

When the interlace signal is handled in a similar manner 
to the MPEG-2, prediction (hereinafter referred to as field 
prediction) can be performed in field units. 

Let us now consider that the case where when the time 
interval of P pictures corresponds to, for example, 3 frames, 
as shown in FIG. 9, the motion picture of the P picture (P4) 
in the fourth frame is detected. 

The first field of the picture P4 is encoded by referring to 
the two fields of the P picture in the first frame. When the 
field prediction is selected, the time interval to the field 
referred to by the first field of the picture P4 corresponds to 
5 fields or 6 fields. The time interval to the field referred to 
by the second field of the picture P4 corresponds to 6 fields 
or 7 fields. When the frame prediction is selected, the time 
interval to the field referred to by two fields of the picture P4 
corresponds to 6 fields. 
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This situation is applicable to the B picture. Fields 
referred to by the two fields of the B picture (B2) in the 
second frame are shown in FIG. 10. Fields referred to by the 
two fields of the B picture (B3) in the third frame are shown 
5 in FIG. 11. The time interval to the field referred to by the 
two fields of the picture B2 corresponds to one field or two 
fields. 

When the encoding is performed by a field structure, 
fields referred to by the two fields of the P picture (P4) in the 

10 fourth frame are shown in FIG. 12. That is, the time interval 
to the field referred to by the first field of the picture P4 
corresponds to five fields or six fields. The time interval to 
the field referred to by the second field of the picture P4 
corresponds to one field or six fields. 

15 Moreover, the dual prediction that performs an average 
prediction between a field in same parity and a field in 
opposite parity is performed in MPEG-2. 

For example, when prediction is performed using a frame 
structure, fields referred to by the two fields of the P picture 

20 (P2) in the second frame are shown in FIG. 13. That is, the 
time interval to the field referred to by the first field of the 
picture P2 corresponds to one field or two fields. The time 
interval to the field referred to by the second field of the 
picture P2 corresponds to two fields or three fields. 

When prediction is performed using a field structure, 
fields referred to by the two fields of the P picture (P2) in the 
second frame are shown in FIG. 14. That is, the time interval 
to the field referred to by the first field of the picture P2 

3o corresponds to one field or two fields. The time interval to 
the field referred to by the second field of the picture P2 
corresponds to one field or two fields. 

As described above, even in the field prediction to, for 
example, the MPEG-2, the shift amount setting section 107 

35 adjusts the shift amount to be set according to the time 
interval, so that the search range setting section 108 can set 
the search range of vector values of a motion vector to a 
suitable value. 

The encoding operation in which the P picture appears 

40 every three frames has been described above. This encoding 
operation can be applied to P pictures or B pictures with 
different structures. Moreover, the encoding operation can 
be applied to even the case where the time interval between 
the input data 101 and the reference image data 102 varies 

45 through frame skipping. 

The search range shift amount of a motion vector value 
obtained from a histogram stored in the histogram storage 
section 109 (or the frequency memory 119) is corrected to an 
actually adjustable value. Then the corrected shift value is 

50 set by the shift amount setting section 107. For example, 
when the horizontal and vertical components of a shift 
amount exceed an actually adjustable search range, the shift 
amount setting section 107 sets the shift amount to a 
adjustable maximum or minimum value. When the shift 

55 amount has a fraction (or the remainder which cannot be 
completely divided by an adjustable pixel unit), the shift 
amount setting section 107 rounds to an adjustable pixel 
unit. 

FIG. 15 shows the configuration of the motion vector 
60 detection device according to the modification of the present 
invention. The motion vector detection device differs from 
that shown in FIG. 2 in the configuration of the histogram 
correction section 106. The histogram correction section 106 
consists of an address creation section 113 and a low-pass 
65 filter (LPF) 120. 

In this case, the low pass filter, for example, can smooth 
the motion vector detection frequency stored in the fre- 
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quency memory 119 to the detection frequency within the indication means for indicating a search range of vector 

3x3 space expanded up, down, right and left. values of a motion vector to be detected by the motion 

In the smoothing process, a local influence on the motion vector detection mean, based on the number of the 

vector detection results can be removed. The motion vector motion vectors classified and stored by said motion 

value search range can be suitably set in the general ten- 5 vector frequency storage means; 

dency. wherein the time interval between said reference image 

FIGS. 16 to 18 are bar graphs showing simulation results data and image data for said current frame differs for 

of the motion vector detection device according to the each frame; and wherein said indication means indi- 

embodiment and the modifications. FIG. 16 shows the cates a motion vector value search range according to 

results obtained by encoding a fast moving image of a 10 a tul i e interval between said reference image data and 

carousel; FIG. 17 shows the results obtained by encoding a data for ^ currem frame 

fast moving image of a bus; and FIG. 18 shows the results 2 Xhe motioQ vector detection device of claim 1> whercin 

obtained by encoding a fast moving image in hockey. said motion yeclor frequency storage ffleaQS classifies 

In the bar graphs shown in FIGS. 16 to 18, the left group mQtion vectors each divided re ^ on detected by aid 

shows the case where images are encoded in frame units K motion vect0f dc{cclion means ^ ^ l0 contain the vector 

while the right j group shows the case where an image are yaJues of , ural motion vcct0r5 Qne afld then 

encoded in field units. In the simulation conditions, it is t . r , f 

assumed that a normal search range of vector values of a st ° res J; he n ™ ber * tb * mo 100 ^ ect . ors - - , . 

motion vector is -48.0. 0 to +47.0 pixels in the horizontal 3 " ^ motlOD vcctor dele f on devi « of claims \: 

direction and 16.0 and 0 to +15.5 pixels in the vertical 'omprismg ™™ **. mcrementing he 

direction and that motion vectors are detected with an 20 Dumber """spending to a range containing said detected 

_ f ac • 1 tu m a- ~ -~ _r~ ~a t „ u-i vector value among motion vector numbers stored in said 

accuracy of 0.5 pixels. The encoding is performed at a bit fe 

rate of 4 Mbit/sec motion vector frequency storage means every time said 

_ r . ™^r,w<,oi . i - motion vector detection means detects the vector value of a 

Referring to FIGS. 16 to 18, the motion vector value is t . t . . f uj*jj 

n * . , , . iL j A t iL j motion vector in each of each divided region. 

fixed to a normal search range m the mode A. In the mode J; molioQ ^ de(eclion ^ q{ ^ j 

B, a histogram is created withm 8 horizontal segments and wherein meaQs indkates ^ motion m 

8 vertical segments by using the motion vector detection « , 

j r""' 0 ' . " , 6 " , " 4 . ... search range so as to center a vector value corresponding to 

device shown m FIG. 2. In the mode C, the smoothing mnvir Z, m mm u ar tu* ™»™ „ "£l r o 

r . . i- . i-i the maximum number among trie motion vector numbers 

process is performed by summing frequencies within the . , A # . . . , ° . . P 

„ „ . , , . i classified and stored by said motion vector frequency stor- 

8x8 pixel segments from a histogram within one pixel 30 a e means 

segment, using the motion vector detection device shown in age means. . • r i • i u 

™% . it^.. iu ■ o 5. The motion vector detection device of claim 1, wherein 

FIG 16. In the mode D, a threshold process is performed to ^ .^.^ ^ a motioQ ^ ^ 

the histogram within one pixel segment. ^ Qn ^ a predetermined 

As the simulation results show, the motion vector detec- yalue a me motion yector oumbcrs dasaified and 

tion devices according to the embodiments and their modi- 35 $tored in said motion yector storage means . 

fications of the present invention can detect large motion 6 The motion yector detection device of claims lf ^ nhQI 

vectors by shifting a search range of vector values of a comprising correction means for correcting a motion vector 

motion vector. For that reason, it is understood that when a number stored {q &m mQ[k)n yectQr frequency storage 

search range is not shifted, the S/N ratio becomes high even meam; and wherem gaid MicAijon means mdicates a 

to a moving image as fast as the motion vector cannot be 4Q motioQ yector fange to be detected by said motkm 

detected. vector detection means, based on the motion vector number 

As described above, according to the present invention, corrected by said correction means, 

the search range of vector values of a motion vector to be 7 The mot i on vector detection device of claims 6, 

detected in the next frame is determined by performing a wherein said correction means includes means for correcting 

statistical process to a motion vector detected every frame. 45 lhe num ber corresponding to a classification containing a 

Consequently, the vector value of a motion vector to be motion vector wilh me vector value of ^ 0 ^ among motion 

detected in the next frame can be adequately predicted, so vector Qum bers stored in said motion vector frequency 

that the motion vector can be properly detected. Moreover, storage means. 

the limited motion vector search range allows the motion g ^ motion vector detection device of claim 6, wherein 

vector computational complexity to be reduced. 50 said correction mean s includes means for smoothing the 

The entire disclosure of Japanese Patent Application No. motion vector numbers classified and stored in said motion 

10-008975 filed on Jan. 20, 1998 including specification, vector frequency storage means within close vector value 

claims, drawing and summary are incorporated herein by ranges by classification. 

reference in its entirety. 9. The motion vector detection device of claims 6, 

What is claimed is: 55 wherein said indication means indicates said motion vector 

1. A motion vector detection device comprising: search range so as to center the vector value corresponding 

motion vector detection means for dividing image data on to a classification having the largest motion vector among 

a current frame into predetermined regions, matching classifications containing the motion vector number cor- 

the image data on said current frame with reference rected by said correction means. 

image data every divided region, and detecting motion 60 10. The motion vector detection device of claims 6, 

vectors with vector values within a search range exter- wherein said indication means indicates a motion vector 

nally indicated; value search range based on numbers with a larger value 

motion vector frequency storage means for classifying the than a predetermined threshold value among the motion 

motion vectors within each divided region detected by vector numbers corrected by said correction means, 

said motion vector detection means under the vector 65 11. The motion vector detection device of claim 1, 

value range and then storing the number of the motion wherein said reference image data comes before and after 

vectors; and image data for said current frame; and wherein said motion 



01/03/2003, EAST Version: 1.03.0002 



US 6,456, 

17 

vector frequency storage means includes means for adjust- 
ing vector values of motion vectors detected by said motion 
vector detection means to provide a different sign when said 
reference image data comes before or after image data for 
said current frame. 5 

12. The motion vector detection device of claim 1, 
wherein said motion vector detection means can detect 
plural motion vectors from each of divided regions; and 
wherein said motion vector frequency storage means assigns 
weights to motion vector numbers detected from each 10 
divided region by said motion vector detection means an d 
then stores the weighted motion vector numbers. 

13. A motion vector detecting method comprising: 

a vector motion detection step of dividing image data for 
a current frame into predetermined regions, matching 15 
the image data of said current frame with reference 
image data every divided region; and detecting a 
motion vector with a vector value within a search range 
externally indicated; 

a motion vector distribution creation step of creating a 20 
distribution where motion vectors detected from each 
divided region in said motion vector detection step are 
classified every range of predetermined vector values; 
and 

25 

an indication step of indicating a motion vector value 
search range to be detected in the motion vector 
detection, based on said distribution created in said 
distribution creation step; 

wherein the time interval between said reference image 30 
data and image data for said current frame differs for 
each frame; and wherein said indicating step indicates 
a motion vector value search range according to a time 
interval between said reference image data and image 
data for said current frame. 35 

14. A motion vector detection device comprising: 
motion vector detection means for dividing image data on 

a current frame into predetermined regions, matching 
the image data on said current frame with reference 
image data every divided region, and detecting motion 40 
vectors with vector values within a search range exter- 
nally indicated; 

motion vector frequency storage means for classifying the 
motion vectors within each divided region detected by 
said motion vector detection means under the vector 45 
value range and then storing the number of the motion 
vectors; 
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indication means for indicating a search range of vector 
values of a motion vector to be detected by the motion 
vector detection mean, based on the number of the 
motion vectors classified and stored by said motion 
vector frequency storage means; and 

correction means for correcting a motion vector number 
stored in said motion vector frequency storage means; 
and wherein said indication means indicates a motion 
vector search range to be detected by said motion 
vector detection means, based on the motion vector 
number corrected by said correction means; 

wherein said correction means includes means for 
smoothing the motion vector numbers classified and 
stored in said motion vector frequency storage means 
within close vector value ranges by classification. 

15. A motion vector detection device comprising: 

motion vector detection means for dividing image data on 
a current frame into predetermined regions, matching 
the image data on said current frame with reference 
image data every divided region, and detecting motion 
vectors with vector values within a search range exter- 
nally indicated; 

motion vector frequency storage means for classifying the 
motion vectors within each divided region detected by 
said motion vector detection means under the vector 
value range and then storing the number of the motion 
vectors; indication means for indicating a search range 
of vector values of a motion vector to be detected by the 
motion vector detection mean, based on the number of 
the motion vectors classified and stored by said motion 
vector frequency storage means; and 

correction means for correcting a motion vector number 
stored in said motion vector frequency storage means; 
and wherein said indication means indicates a motion 
vector search range to be detected by said motion 
vector detection means, based on the motion vector 
number corrected by said correction means; 

wherein said indication means indicates said motion vec- 
tor search range so as to center the vector value 
corresponding to a classification having the largest 
motion vector among classifications containing the 
motion vector number corrected by said correction 
means. 
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